BaNa: a noise resilient fundamental frequency detection algorithm for speech and music

Fundamental frequency (F0) is one of the essential features in many acoustic related applications. Although numerous F0 detection algorithms have been developed, the detection accuracy in noisy environments still needs improvement. We present a hybrid noise resilient F0 detection algorithm named BaNa that combines the approaches of harmonic ratios and Cepstrum analysis. A Viterbi algorithm with a cost function is used to identify the F0 value among several F0 candidates. Speech and music databases with eight different types of additive noise are used to evaluate the performance of the BaNa algorithm and several classic and state-of-the-art F0 detection algorithms. Results show that for almost all types of noise and signal-to-noise ratio (SNR) values investigated, BaNa achieves the lowest Gross Pitch Error (GPE) rate among all the algorithms. Moreover, for the 0 dB SNR scenarios, the BaNa algorithm is shown to achieve 20% to 35% GPE rate for speech and 12% to 39% GPE rate for music. We also describe implementation issues that must be addressed to run the BaNa algorithm as a real-time application on a smartphone platform.Peer ReviewedPostprint (author's final draft

In vivo quantitative evaluation of gold nanocages' kinetics in sentinel lymph nodes by photoacoustic tomography

As a new class of sentinel lymph node (SLN) tracers for photoacoustic (PA) imaging, Au nanocages offer the advantages of noninvasiveness, strong optical absorption in the near-infrared region (for deep penetration), and accumulation in higher concentrations than the initial injected solution. By monitoring the amplitude changes of PA signals in an animal model, we quantified the accumulations of nanocages in SLNs over time. Based on this method, we quantitatively evaluated the kinetics of gold nanocages in SLN in terms of concentration, size, and surface modification. We could detect the SLN at an Au nanocage injection concentration of 50 pM and a dose of 100 μL in vivo. This concentration is about 40 times less than the previously reported value. We also investigated the influence of nanocages' size (50 nm and 30 nm in edge length), and the effects of surface modification (with positive, or neutral, or negative surface charges). The results are helpful to develop this AuNC-based PA imaging system for noninvasive lymph node mapping, providing valuable information about metastatic cancer staging

One-shot Implicit Animatable Avatars with Model-based Priors

Existing neural rendering methods for creating human avatars typically either require dense input signals such as video or multi-view images, or leverage a learned prior from large-scale specific 3D human datasets such that reconstruction can be performed with sparse-view inputs. Most of these methods fail to achieve realistic reconstruction when only a single image is available. To enable the data-efficient creation of realistic animatable 3D humans, we propose ELICIT, a novel method for learning human-specific neural radiance fields from a single image. Inspired by the fact that humans can effortlessly estimate the body geometry and imagine full-body clothing from a single image, we leverage two priors in ELICIT: 3D geometry prior and visual semantic prior. Specifically, ELICIT utilizes the 3D body shape geometry prior from a skinned vertex-based template model (i.e., SMPL) and implements the visual clothing semantic prior with the CLIP-based pretrained models. Both priors are used to jointly guide the optimization for creating plausible content in the invisible areas. Taking advantage of the CLIP models, ELICIT can use text descriptions to generate text-conditioned unseen regions. In order to further improve visual details, we propose a segmentation-based sampling strategy that locally refines different parts of the avatar. Comprehensive evaluations on multiple popular benchmarks, including ZJU-MoCAP, Human3.6M, and DeepFashion, show that ELICIT has outperformed strong baseline methods of avatar creation when only a single image is available. The code is public for research purposes at https://huangyangyi.github.io/ELICIT/.Comment: To appear at ICCV 2023. Project website: https://huangyangyi.github.io/ELICIT

A New Theranostic System Based on Gold Nanocages and Phase-Change Materials with Unique Features for Photoacoustic Imaging and Controlled Release

This communication reports a new theranostic system with a combination of capabilities to both enhance the contrast of photoacoustic (PA) imaging and control the release of a chemical or biological effector by high-intensity focused ultrasound (HIFU). The fabrication of this system simply involves filling the hollow interiors of gold nanocages with a phase-change material (PCM) such as 1-tetradecanol that has a melting point of 38−39 °C. The PCM can be premixed and thus loaded with a dye, as well as other chemical or biological effectors. When exposed to direct heating or HIFU, the PCM will melt and escape from the interiors of nanocages through small pores on the surface, concurrently releasing the encapsulated molecules into the surrounding medium. We can control the release profile by varying the power of HIFU, the duration of exposure to HIFU, or both

In vivo quantitative evaluation of gold nanocages' kinetics in sentinel lymph nodes by photoacoustic tomography

As a new class of sentinel lymph node (SLN) tracers for photoacoustic (PA) imaging, Au nanocages offer the advantages of noninvasiveness, strong optical absorption in the near-infrared region (for deep penetration), and accumulation in higher concentrations than the initial injected solution. By monitoring the amplitude changes of PA signals in an animal model, we quantified the accumulations of nanocages in SLNs over time. Based on this method, we quantitatively evaluated the kinetics of gold nanocages in SLN in terms of concentration, size, and surface modification. We could detect the SLN at an Au nanocage injection concentration of 50 pM and a dose of 100 μL in vivo. This concentration is about 40 times less than the previously reported value. We also investigated the influence of nanocages' size (50 nm and 30 nm in edge length), and the effects of surface modification (with positive, or neutral, or negative surface charges). The results are helpful to develop this AuNC-based PA imaging system for noninvasive lymph node mapping, providing valuable information about metastatic cancer staging

Gold nanocages covered with thermally-responsive polymers for controlled release by high-intensity focused ultrasound

This paper describes the use of Au nanocages covered with smart, thermally-responsive polymers for controlled release with high-intensity focused ultrasound (HIFU). HIFU is a highly precise medical procedure that uses focused ultrasound to heat and destroy pathogenic tissue rapidly and locally in a non-invasive or minimally invasive manner. The released dosage could be remotely controlled by manipulating the power of HIFU and/or the duration of exposure. We demonstrated localized release within the focal volume of HIFU by using gelatin phantom samples containing dye-loaded Au nanocages. By placing chicken breast tissues on top of the phantoms, we further demonstrated the feasibility of this system for controlled release at depths up to 30 mm. Because it can penetrate more deeply into soft tissues than near-infrared light, HIFU is a potentially more effective external stimulus for rapid, on-demand drug release

In Vivo Quantitative Evaluation of the Transport Kinetics of Gold Nanocages in a Lymphatic System by Noninvasive Photoacoustic Tomography

Sentinel lymph node (SLN) biopsy has emerged as a preferred method for axillary lymph node staging of breast cancer, and imaging the SLN in three-dimensional space is a prerequisite for the biopsy. Conventional SLN mapping techniques based on the injection of an organic dye or a suspension of radioactive colloids suffer from invasive surgical operation for visual detection of the dye or hazardous radioactive components and low spatial resolution of Geiger counters in detecting the radioactive colloids. This work systematically investigates the use of gold nanocages (AuNCs) as a novel class of optical tracers for noninvasive SLN imaging by photoacoustic (PA) tomography in a rat model. The transport of AuNCs in a lymphatic system and uptake by the sentinel lymph node were evaluated by PA tomography on the axillary region of a rat. Quantification of AuNCs accumulated in the lymph node was achieved by correlating the data from PA imaging with the results from inductively-coupled plasma mass spectrometry. Several parameters were systematically evaluated and optimized, including the concentration, size, and surface charge of the AuNCs. These results are critical to the further development of this AuNC-based PA tomography system for noninvasive SLN imaging, providing valuable information for metastatic cancer staging

A New Theranostic System Based on Gold Nanocages and Phase-Change Materials with Unique Features for Photoacoustic Imaging and Controlled Release

This communication reports a new theranostic system with a combination of capabilities to both enhance the contrast of photoacoustic (PA) imaging and control the release of a chemical or biological effector by high-intensity focused ultrasound (HIFU). The fabrication of this system simply involves filling the hollow interiors of gold nanocages with a phase-change material (PCM) such as 1-tetradecanol that has a melting point of 38−39 °C. The PCM can be premixed and thus loaded with a dye, as well as other chemical or biological effectors. When exposed to direct heating or HIFU, the PCM will melt and escape from the interiors of nanocages through small pores on the surface, concurrently releasing the encapsulated molecules into the surrounding medium. We can control the release profile by varying the power of HIFU, the duration of exposure to HIFU, or both

Gold nanocages covered with thermally-responsive polymers for controlled release by high-intensity focused ultrasound

This paper describes the use of Au nanocages covered with smart, thermally-responsive polymers for controlled release with high-intensity focused ultrasound (HIFU). HIFU is a highly precise medical procedure that uses focused ultrasound to heat and destroy pathogenic tissue rapidly and locally in a non-invasive or minimally invasive manner. The released dosage could be remotely controlled by manipulating the power of HIFU and/or the duration of exposure. We demonstrated localized release within the focal volume of HIFU by using gelatin phantom samples containing dye-loaded Au nanocages. By placing chicken breast tissues on top of the phantoms, we further demonstrated the feasibility of this system for controlled release at depths up to 30 mm. Because it can penetrate more deeply into soft tissues than near-infrared light, HIFU is a potentially more effective external stimulus for rapid, on-demand drug release

Comparison Study of Gold Nanohexapods, Nanorods, and Nanocages for Photothermal Cancer Treatment

Gold nanohexapods represent a novel class of optically tunable nanostructures consisting of an octahedral core and six arms grown on its vertices. By controlling the length of the arms, their localized surface plasmon resonance peaks could be tuned from the visible to the near-infrared region for deep penetration of light into soft tissues. Herein we compare the in vitro and in vivo capabilities of Au nanohexapods as photothermal transducers for theranostic applications by benchmarking against those of Au nanorods and nanocages. While all these Au nanostructures could absorb and convert near-infrared light into heat, Au nanohexapods exhibited the highest cellular uptake and the lowest cytotoxicity in vitro for both the as-prepared and PEGylated nanostructures. In vivo pharmacokinetic studies showed that the PEGylated Au nanohexapods had significant blood circulation and tumor accumulation in a mouse breast cancer model. Following photothermal treatment, substantial heat was produced in situ and the tumor metabolism was greatly reduced for all these Au nanostructures, as determined with ^(18)F-flourodeoxyglucose positron emission tomography/computed tomography (^(18)F-FDG PET/CT). Combined together, we can conclude that Au nanohexapods are promising candidates for cancer theranostics in terms of both photothermal destruction and contrast-enhanced diagnosis